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Abstract. Let G be a transitive group of permutations of a finite set SI, and suppose that some 
element of G has at most two orbits on SI. We prove that any two maximal chains of groups 
between G and a point-stabilizer of G have the same length, and the same sequence of relative 
indices between consecutive groups (up to permutation) . We also deduce the same conclusion when 
G has a transitive quasi-Hamiltonian subgroup. 



1. Introduction 

One of the few mistakes in Jordan's classic Traite des substitutions is an assertion that would 
now be called the Jordan-Holder theorem for transitive G-sets. Specifically, he asserted in [7, §51, 
p. 38] that, for every subgroup H of a finite group G, the pair (G, H) has the following property: 

Definition 1.1. Let H be a finite-index subgroup of a group G. We say the pair (G,H) has the 
Jordan property when the following holds: if A\ $ • • • $ A a and Bi C ... C g 6 are maximal 
chains of groups between H and G, then a = b and the sequence ([A2 : Ax], . . . , [A a : A a -±]) is a 
permutation of ([B2 : B\], . . . , [B^ : B^^i]). 

Jordan realized his mistake soon after publication, and retracted his assertion [BJ; the smallest 
counterexample is (Ai,l), in which 1 < C2 < Va < A4 and 1 < G3 < A4 are maximal chains 
having distinct lengths. A half-century later, Ritt discovered that (G, H) has the Jordan property 
if G = HI for some finite cyclic subgroup I of G; this was a key ingredient in Ritt's work on 
functional equations, yielding a fundamental invariant of functional decompositions of a complex 
polynomial. After another sixty years, Miiller showed that (G, H) has the Jordan property if 
G = HI for some finite abelian subgroup / of G. We will give a simpler proof of Miiller 's result, 
while also extending it to a larger class of groups: 

Proposition 1.2. If H is a subgroup of a group G, and G = HI for some finite subgroup I of G 
such that 

(*) any two subgroups of I are permutable (i.e., I\Ii = hli), 

then (G, H ) has the Jordan property. 

Note that I1I2 = hh if and only if I1I2 is a group, or equivalently I2) = (#Ii)[h '■ h ^h}- 
Abelian groups / satisfy (*), as do Hamiltonian groups (i.e., nonabelian groups with no nonnormal 
subgroups). As shown by Dedekind [3], the finite Hamiltonian groups consist of the direct products 
of the order-8 quaternion group with an abelian group containing no elements of order 4. There 
is a similar but less known classification of finite groups satisfying (*) (called quasi-Hamiltonian 
groups), due to Pic [17] . 

Our main result says that (G, H) has the Jordan property if some cyclic subgroup I of G has 
two orbits on the set of cosets of H in G: 
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Theorem 1.3. Let H be a subgroup of a group G, and let I be a finite cyclic subgroup of G such 
that G = IH U IgH for some g £ G. Then (G, H) has the Jordan property. 

By means of a now-standard inductive argument due to Netto (cf. Lemma l2.ip . this result is a 
consequence of the following: 

Theorem 1.4. Let G be a transitive group of permutations of a finite setQ, fixu) G £1, and suppose 
some element of G has at most two cycles on £1. If A and B are distinct maximal subgroups of G 
for which H := A n B contains G^, then one of the following holds: 

(1.4.1) H is a maximal subgroup of both A and B, and G = AB; or 

(1.4.2) G/ coreciH) is dihedral of order 2r, with r prime, and both A and B have order 2 images 
in Gj coreciH). 

Here, as usual, coreciH) is the maximal normal subgroup of G contained in H. Possibility (jl.41 2) 
illustrates a phenomenon not arising in Proposition ll.21 if G contains a transitive quasi-Hamiltonian 
subgroup, then ([1.41 1) holds. 

We will give examples showing that Assertion 11.11 need not hold for transitive groups G containing 
an element with three cycles, and likewise for transitive groups G containing an abelian subgroup 
with two orbits. However, in some sense the counterexamples in both situations appear to be 
bounded, so it may be possible to classify the counterexamples to Theorem 11.41 in these more 
general situations. 

Our work was motivated by geometric applications. Specifically, Theorem 11.31 has the following 
consequence: 

Corollary 1.5. Let C and D be smooth, projective, geometrically irreducible curves over a field K , 
and let f : C — > D be a nonconstant separable rational map defined over K . Suppose that some place 
of D is tamely ramified in f , and lies under at most two places of C . Let C — > A\ — > A<i — > ■ ■ ■ — » D 
and C — > B\ — > B2 — > • • • —* D be maximal decompositions of f into rational maps of degree more 
than 1. Then these decompositions have the same length, and (up to permutation) the same sequence 
of degrees of the involved indecomposable maps. 

The simplest case C = D = P 1 is already interesting: there / is essentially a Laurent polynomial. 

Corollary 1.6. Let f £ -fT^x -1 ] be a Laurent polynomial over a field K, and assume that neither 
x = nor x = 00 is a pole of f of order divisible by char(K). Write f = a\ o • • • o a r = b\ o ■ • • o b s 
where aj, bj £ K{x) are indecomposable and have degree more than 1. Then r = s, and the sequence 
(deg(ai), . . . ,deg(a r )) is a permutation of (deg(6i), . . . , deg(£> s )). 

In case K = C, this result was proved in the recent paper [20J; subsequently another proof 
was given in [15]. Conversely, the K = C case of Corollary 11.61 is equivalent to some special 
cases of Theorem II. 3[ in view of Riemann's existence theorem and knowledge of the fundamental 
group of the punctured sphere. Specifically, the K = C case of Corollary 11.61 is equivalent to 
Theorem 11.31 for groups G having generators gi,---,gk where g\ has two cycles and 5152 • • • 5fc = 1 
and 2#S - 2 = £\(#5 - # cycles ( 5i )). 

The proofs in [20J and [15J relied on various algebro-geometric calculations, which were much more 
complicated than the proof in the present paper. On the other hand, in case K = C, those papers 
obtained quite precise information about the shape of the indecomposable rational functions a, and 
bj occurring in Corollary 11.61 This precise information relies on the fact that C and D have genus 
zero, so it is not surprising that geometry is required for the proof. However, since Corollary 11.61 
has a group-theoretic interpretation, this result seemed to merit a group-theoretic proof, which we 
produce in the present paper. As a bonus, this group-theoretic proof implies Corollary 11.61 even 
for fields of positive characteristic, and also implies Corollary 11.51 essentially, the group-theoretic 
proof uses just the ramification data at the special point, whereas the geometric proofs used the 
ramification data at all points, hence required stronger hypotheses. 
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Ritt proved Corollary 11.61 in case K = C and / is a polynomial [18J. He also determined the 
possibilities for the cij's and bj's, and his results have been applied to a wide range of topics (cf. 
[H El HI nol [13j [HI [TU [19], among others). Here we mention just the most recent application, 
from [5]: 

Theorem 1.7 (Ghioca-Tucker-Zieve). Let xo,yo £ C and f,g€ C[x] satisfy deg(/), deg(g) 7^ 1. 
7/ i/ie orbits 

{x ,f(x )J{f{x )),...} and {y , g(y ), g(g{yo)), ■■■ } 
have infinite intersection, then f and g have a common iterate. 

It would be of great interest to extend this result to Laurent polynomials or more general rational 
functions. We suspect the group theoretic perspective of the present paper may be useful in this 
endeavor. 

We now summarize the contents of this paper. In the next section we present a version of 
the diamond lemma, which we use in Section [3] to prove Proposition 11.21 In Section U] we record 
the terminology of G-sets needed for the proofs of our main results, and in Section [3] we prove 
Theorems 11.31 and 11.41 We conclude in the final section with some examples and speculations. 



In order to prove that a pair of groups has the Jordan property, it suffices to consider pairs of 
chains whose common least element is the intersection of their two second-largest elements. This 
generalizes an argument due to Netto |llj . 




Lemma 2.1. Let C be a set of pairs (G,H) of a group G and a finite-index subgroup H, and 
suppose that if (G,H) G C and H < Gq < G then C contains both (Gq,H) and (G, Go). Suppose 
further that, if (G, H) G C and A, B are distinct maximal subgroups of G with H = A n B , then 
there exist maximal chains of groups G > A > ■ ■ ■ > H and G > B > • • • > H such that the 
sequences of indices in the two chains are the same up to permutation. It follows that every pair in 
C has the Jordan property. 

Proof. Pick (G, H) G C with [G : H] = d, and suppose the result holds for pairs with smaller 
index. Let Aq < A\ < • • • < A r and Bq < ■ ■ ■ < B s be maximal chains of groups between H 
and G. Then A r = B s = G, and A r ^\ and B s _\ are maximal subgroups of G. If A r -\ = B s _\ 
then the result follows from the corresponding result for (A r —i,H). So assume A r —\ 7^ -B s _ 1, 
and let K = A r _\ n B s _\. The hypothesis for the case (G,K) is that there are maximal chains 
G > A r -i > ■ • • > K and G > B s -\ > ■ ■ ■ > K for which the sequences of indices are the same 
up to permutation. Pick a maximal chain K > • • • > H, and concatenate with the previous chains 
to get maximal chains G > A T -\ > ■ ■ ■ > H and G > B s ^\ > ■ ■ ■ > H with the same multiset of 
indices. The result for (A r _i, H) implies that the multiset of indices for the first chain equals that 
for the Ai chain. The result for (B s _i, H) implies that the multiset for the second chain equals that 
for the Bj chain. Thus, the Ai chain has the same multiset of indices as does the Bj chain. □ 



In this section we prove Proposition 11.21 In light of Lemma 12.11 it suffices to prove the following: 

Proposition 3.1. Let H be a subgroup of a group G, and suppose that G = HI for some finite 
subgroup I of G satisfying (*). If A,B are distinct maximal subgroups of G with A (IB = H, then 
H is maximal in both A and B, and G = AB. 



2. Diamond lemma 




3. Groups with a transitive quasi-Hamiltonian subgroup 



We begin with a general lemma on subgroups of groups of this form. 
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Lemma 3.2. Let H and I be subgroups of a group G such that G = HI. Then W i— > W D / is an 
injective map from the set of groups between G and H to the set of groups between I and I D H. 
This map preserves indices between pairs of groups, and its image is closed under intersections and 
joins (where the join of two groups is the group they generate). 

Proof. Let W be a group between H and G, so W is a union of cosets of H, and each such coset 
contains an element of I, whence W = H(W n I). Thus [W : H] = [W n I : H H I}. If A, B are 
groups between H and G, write A = HC and B = HD with C,D < I. Then AnB = i^E 1 with 

£ = I n (A n B) = (/ n A) n (/ n B) = c n D. 

Also fl"(C, D) = (C, D)H, and hence equals (HC, HD). □ 

In view of Lemma |3.2[ Proposition 13. II is a consequence of the following result: 

Lemma 3.3. Let I be a finite group satisfying (*), let H be a subgroup of I, and let I be a set of 
groups between H and I which includes both H and I, and which is closed under intersections and 
joins. If A, B are maximal subgroups of I with A D B = H , then H is maximal in both A and B, 
and I = AB. 

Proof. Let A, B be distinct maximal elements of I\ {I}. Then / = AB, so [I : B] = [A : A PI B\. 
Also if J € T is strictly between AdB and A, then [BJ : B] = [J : Af)B] so BJ is strictly between 
B and /, contradicting maximality. Therefore both chains A n B < A < I and AD B < B < I are 
maximal in I. □ 

This completes the proof of Proposition 13. 1\ and so of Proposition 11.21 

Remark. Mulder's proof of Proposition 13.11 in the case of abelian groups I is substantially more 
complicated than the one given above. 

4. G-SETS 

In this section we record some notation and terminology involving G-sets. For standard notions 
of G-sets, we refer to |12j . which we follow when possible; below we give the details of some notions 
that are not universally used. 

Given a group G, by a G-set we mean a nonempty set Q together with a homomorphism p : G — > 
Sym(f2). For g £ G and w £ fl, we write to 9 for (p(g))(uj). An equivalence relation <f) on the G-set 

is said to be G-invariant if 

a = (3 (mod (j)) => a 9 = (3 9 (mod <j>) for every g € G. 

Such an equivalence relation is called a congruence on f2. If <f> is a congruence on f2, then the action 
of G on f2 naturally induces an action of G on the set f2/</> of ^-equivalence classes on f2; the G-set 
Q/(f> is called the quotient of the G-set by the congruence (j). The notions of transitive G-sets, 
homomorphisms of G-sets, isomorphisms of G-sets, and direct products of G-sets are defined in the 
usual manner. 

Let (p and ip be two congruences on a G-set f2. We say that 4> coarsens ip (or equivalently, ip 
refines <j>) if every (^-equivalence class is a union of "^-equivalence classes. We denote the coarsest 
common refinement of (j) and ip by <f> A ip; thus, each <fi A V'-equivalence class is the intersection 
of a (^-equivalence class and a ^-equivalence class. We denote the finest common coarsening of <fi 
and ip by (f) V ip; each p V -^-equivalence class is a union of (^-equivalence classes, and also a union 
of ^-equivalence classes. We write <p^ for the coarsening of p> in which two (^-equivalence classes 
are (/^-equivalent if they nontrivially intersect the same V'-equivalence classes. We emphasize that 
p Atp, p\J ip, and <$r are congruences on £1. 

Any G-set f2 comes equipped with two trivial congruences: the trivial coarse congruence, in 
which Q is itself an equivalence class; and the trivial fine congruence, in which every equivalence 
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class contains a single element. Any congruence besides these two is said to be nontrivial. We 
usually identify O with its trivial coarse congruence. We say a transitive G-set is primitive if it 
admits no nontrivial congruences. 

Let (p and ip be congruences on a transitive G-set f2. Then 0,/cp and Q/ip are transitive, so any 
two ■(/'-equivalence classes have the same size, and likewise for any two (^-equivalence classes. If (p 
coarsens ip, then every (^-equivalence class consists of the same number k of ^-equivalence classes; 
we call k the index of ip in cp, and denote this by [cp : ip]. 

The following lemma is routine. 

Lemma 4.1. Let $7 be a transitive G-set, and pick u 6 0,. Define a map 9 from the set of 
congruences on SI to the set of groups between G and G u as follows: let 9{(p) be the stabilizer of the 
image of uj in the G-set Q/<p. Then 

• 9 is a bisection; 

• <p coarsens ip if and only if 9{ip) is a subgroup of 9{<p); and 

• if 4> coarsens ip then [cp : ip] = [6(4>) '■ 9(ip)]. 

Note that the final two assertions say that 9 is order-preserving and index-preserving. 

Finally, we remark that the proof in the previous section can be translated to the languate of 
G-sets. Specifically, let I be a finite quasi-Hamiltonian subgroup of a group G, and let A and B be 
distinct maximal subgroups of G for which H := A n B satisfies G = HI. Let fi be the G-set of 
left cosets of H in G, and let <p and ip be the congruences on Q corresponding (via Lemma l4.ip to 
A and B. Then, for I\,l2 < I , the property l\l2 = I2I1 can be restated as the condition that <p V tp 
should be the full coset space I /I\l2- Thus, the proof in the previous section can be stated either 
in terms of groups or congruences, with little conceptual difference. On the other hand, in the next 
section we will find the congruence viewpoint to be more suitable for the problem at hand. 

5. Transitive groups with an element having at most two cycles 

In this section we prove Theorem 1 1.4( by Lemma |2. II this implies Theorem II. 31 

Given a group G and a finite-index subgroup H, let f2 be the transitive G-set of left cosets of H 
in G. Suppose g £ G has at most two orbits (= cycles) on Q. Let (p an d ip be nontrivial congruences 
on £1. Suppose further that (p and ip have no nontrivial common refinement, so any (^-equivalence 
class intersects any ^-equivalence class in at most one element - thus Vt embeds (as a G-set) into 
Q/(p x Q/ip. Suppose also that (p and ip have no nontrivial common coarsening. We maintain the 
above notation throughout this section. 

By Lemmas 12.11 and 14.11 to prove Theorem 1 1.41 it suffices to show: if £l/<p and £l/ip are primitive, 
then either G/ coieciH) is dihedral or 0, = £l/(p x 0,/ip where both (p and ip are maximally fine 
nontrivial congruences. It will be convenient to do some arguments without assuming primitivity. 

We begin by observing how g-cyles on £1 relate to g-cycles on Vt/(p and Q/ip. 

Lemma 5.1. Pick u£0, and suppose the image of lo in Q/cp lies in a g-cycle of length a, and 
the image uj^ of uj in Q/ip lies in a g-cycle of length b. Then u lies in a g-cycle of length lcm(a, b). 
The g& cd ( a > b ) -orbit of uj is a union of (p- equivalence classes, and also is a union of ip- equivalence 
classes. The congruence <p^ nontrivially coarsens (p unless either a = b or gcd(a,6) = 1. 

Proof. Plainly g r fixes uj^ precisely when o | r, and g r fixed uj^ precisely when b \ r. Since g r 
fixes uj if and only if g r fixes both uj^ and <xy,, it follows that u is in a (7-cycle of length lcm(a, b). 
The (^-equivalence classes on Q./<p are precisely the <? a -cycles; the -^-equivalence classes are likewise 
the g 6 -cycles. Hence the g gcd ( a ' fe )-orbit of w is a union of (^-equivalence classes, and also a union 
of ^-equivalence classes. Finally, the (^-equivalence class {g a )g t u) ( f ) nontrivially intersects just the 
■0-equivalence classes (g b )g ar+l uj^, or in other words the classes containing elements of the form 
ggcd(a, fe ) s +* a; ^ i Thus, two 0-classes (g a )g w<t ' and (g a )g^ u} ' t ' become equivalent in if and only if 
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i = j (mod gcd(a, 6)). Here 0^ is the trivial coarse partition if gcd(a, b) = 1, and 0"^ = if a \ b; 



We split the proof of Theorem 11.41 into several cases. In the first case we illustrate our method 
by using it to prove Ritt's result (which is needed to verify the 'closure' hypothesis in Lemma [2. ip . 

Case 1. If g has a single cycle on $7, and both $7/0 and Q/tp are primitive, then $7 = $7/0 x Cl/ip 
and both and if) are maximally fine nontrivial congruences. 

Proof. Let a and b be the lengths of the cycles of g on $7/0 and O/*0, respectively. Since an d ip 
have no nontrivial common coarsening, V ip is trivial, so Lemma 1 5 . 1 1 implies gcd(a, b) = 1. Thus 
$7 = $7/0 x $7/-0. If the congruence // nontrivially refines ip, then $7t^$7/0x$7//x, so n must not 
satisfy the same hypotheses as ip] hence and /i have a nontrivial common coarsening. This is not 
possible if $7/0 is primitive. □ 

Case 2. If g has two cycles on both $7/0 and Cl/ip, then V ip is nontrivial. 

Proof. Let 0' be the equivalence relation on $7 whose two equivalence classes are the unions of the 
0-equivalence classes comprising the two cycles of g on $7/0. Then g acts trivially on 0/0'. Since g 
has two cycles on $7, and each cycle is contained in a (^'-equivalence class, the (//-equivalence classes 
are precisely the g-cycles on $7. Since the same holds for i//, it follows that 0' = ip' is a nontrivial 
common coarsening of an d ip, so V ip is nontrivial. □ 

Case 3. Suppose the g-cycles on Q/(f> have lengths a\ and ai, and Vl/tp is a g-cycle of length b. 
Then = $7/0 x Q/if), and if $7/0 and are primitive then both and tp are maximally fine 
nontrivial congruences, congruence. 

Proof. By Lemma l5.1( the (7-cycles on $7 have lengths lcm(ai,6) and lcm(a2,6), and consist of a± 
and 02 0-equivalence classes; since G is transitive on $7/0, every such equivalence class has the same 
size, so lcm(ai,6)/oi = Icm(a2,6)/a2 and thus gcd(ai,6) = gcd(a2,6). Since V ip is nontrivial, 
Lemma 15 . 1 1 implies gcd(ai,6) = 1, so $7 = $7/0 x $7/-0. 

Let \i be a nontrivial congruence refining ip; if V/i is nontrivial, then primitivity of $7/0 implies 
V /x = 0, so n is a nontrivial common refinement of and "0, contradiction. Thus V /i is 
trivial, so from Case 2 we know that g acts cyclically on $7//x. Then the previous paragraph implies 
$7 = $7/0 x f2//i, so fi = -0- The same argument shows that is also a maximally fine nontrivial 
congruence. □ 

Case 4. Suppose g is an a-cycle on $7/0 and a b-cycle on Q/ip, but g has two cycles on $7. Then 
either gcd(a, b) > 2, or both gcd(a, b) = 2 and $7 = $7/0x$7/'0. 

Proof. By Lemma |5.1| each g-cycle on $7 has length lcm(a, b). Since $7 embeds in the G-set $7/0 x 
$7/ , 0, which has cardinality ab, it follows that gcd(a, b) > 2, with equality if and only if $7 = 



Henceforth suppose the situation of Case 4 holds, and suppose also that $7/0 and $7/^ are 
primitive. 

Case 4a. If gcd(a,6) > 2 then G/ cotqg{H) is dihedral of order twice a prime, and the trivial fine 
congruence has index 2 in both and tp. 

Proof. By Lemma |5. II 0^ is nontrivial unless a \ b, and likewise ijj^ is nontrivial unless b \ a. Thus, 
primitivity implies a = b. View $7 as the edges of a bipartite graph V whose vertices are $7/0 and 
$7/'0. By the previous inference, V is 2-regular. The classes of V ip correspond to the connected 
components of T; so if $7/'0 is primitive, Gamma is connected. Thus V is a cycle of length 2a. 
Now G j coreciH) Q Aut(T), where here we only consider the automorphisms that preverse T as 
a bipartite graph. But Aut(T) = D a , and D a acts freely transitively on $7. Because Gj coieciH) 
acts transitively, it is also isomorphic to D a . Since $7/0 is primitive, a is prime. □ 




□ 



$7/0 x n/ip. 



□ 
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Case 4b. If gcd(a, b) = 2 and £1 = Q,/<j) x Cl/ip, then both 4> and ip are maximally fine nontrivial 
congruences. 

Proof. Suppose not, and let \i ^ ip be a nontrivial congruence refining ip. If g has two cycles on 
f2//x then Case 3 provides a contradiction. Thus, g acts as a c-cycle on f2//i. Lemma 15.11 implies 
a | c. Since \i refines ip, we also have b \ c. Thus c is divisible by lcm(a, b) = ab/2, and c divides 
= afe. Since /i is nontrivial, we have c 7^ at, so c = ab/2, and thus each /^-equivalence class has 
size 2. Finally, V ^ has precisely two equivalence classes (and so is nontrivial) unless 6 = 2 and 
c = a. But if a = c then, as above, G / corec(H) is dihedral. However, this cannot happen here, 
because a is not prime. □ 

Remark. We stated the diamond lemma (Lemma 12. ip in terms of descending chains of groups 
(with A and B maximal subgroups of G which meet in H); there is an analogous result in terms 
of ascending chains (with A and B minimal overgroups of H in G which generate G). However, 
we do not see how to do the proof this way, since we do not know how to make a congruence that 
behaves with regard to refining in the same way that (p^ behaves for coarsening. 

6. Data and speculations 

Theorem 11.31 is not true if we allow / to be an abelian group with two orbits (on the G-set 
Q of left cosets of H in G). For instance, let G be the group of permutations of F9 of the form 
x 1 ► olx ~\~ j3 with [5 € F9 and a 4 = 1. Let A and B be the subgroups {±x + f3 : (3 E Fg} and 
{x 1— > ax : a 4 = 1}. Then two maximal chains of groups between H := {±x} and G are H < B < G 
and H < {±x + (3 : (3 € F3} < A < G, which have different lengths. However, the abelian group 
{x + f3 : f3 G Fg} has two orbits on £2. 

There are also counterexamples to Theorem 11.31 if we allow / to be a cyclic group with three 
orbits on 0,. For instance, let H be an order-2 subgroup of £4 which is not contained in A^; then 
any cyclic subgroup of order 4 has three cycles on 17, but two maximal chains of groups between 
H and G are H < S3 < S 4 and H <V 4 < D 8 < S 4 . 

However, computer searches on small groups suggest there are extremely few examples in these 
situations. In fact, it may be that there are only finitely many finite groups G containing a core- free 
subgruop H such that (G, H) does not have the Jordan property, but G contains an element having 
precisely three cycles on the coset space fi. As yet we have not been able to extend the methods 
of this paper to analyze such a situation. 
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